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Many natural, technological and social systems are inherently not in equilibrium. We show, by 
detailed analysis of exemplar models, the emergence of equilibrium-like behavior in localized or non- 
localized domains within non-equilibrium systems as conjectured in some real systems. Equilibrium 
domains are shown to emerge either abruptly or gradually depending on the system parameters 
and disappear, becoming indistinguishable from the remainder of the system for other parameter 
values. The models studied, defined on densely and sparsely connected networks, provide a useful 
representation of many real systems. 
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Equilibrium is a fundamental concept in statistical 
physics it assumes that while the system dynamics 
is governed by microscopic interactions, some systems 
eventually reach a state where macroscopic observables 
remain unchanged. The evolution of such systems is 
driven by the corresponding Hamiltonian energy function 
and their states converge to the equilibrium distribution 
which is a function of energy only; all macroscopic prop- 
erties of the system then follow from this distribution. 

The dynamics of a non-equilibrium system, on the 
other hand, is typically not governed by a process de- 
rived from a Hamiltonian and such systems do not con- 
verge to an equilibrium state 0, Q . This is assumed to 
be true for many real systems, for instance in the finan- 
cial, social and biological areas. However, constituents of 
some of these systems exhibit equilibrium-like behavior in 
emerging localized or non-localized domains; notable ex- 
amples of this behavior are the emergence of equilibrium- 
like structures in functional brain networks neuronal 
dynamics Q and the theory of markets Q . Consequently, 
such domains may exist under some conditions within 
many other non-equilibrium systems but are difficult to 
identify. 

Most systems in statistical physics fall into one of these 
two categories 0] ; the evolution of both equilibrium and 
non-equilibrium systems (in discrete time steps) is char- 
acterized by a trajectory s(0) s(t), where s{t) is 
a microscopic state of the system (microstate) at time t. 
For Markovian processes this probability can be decom- 
posed to a chain of transition probabilities from one time 
step to the next resulting in the joint probability 



P[s(0) 



W[s(t)|s(t- 



(1) 



1)] X ••• X W[s(l)|s(0)] P(s(0)) 



with initial P(s(0)) and transition W[s(i:)|s(< — 1)] prob- 
ability distributions. Expectation value of any macro- 
scopic observable M{s{t)), i.e., a function of microstates 
defining a macrostate, can be computed from the prob- 
ability distribution (HI). Unfortunately, even for highly 
stylized models of statistical physics this procedure is 
non-trivial @. In equilibrium systems, one assumes 
that the probability of any microscopic trajectory is in- 
variant under time-reversal; this leads to a property 



termed detailed balance for the stationary distribution 
Pcx)(s) of process (H]), where transitions from state s to 
s are balanced by transitions in the opposite direction 
W[s|s] Poo(s) = W[s|s] Poo(s). For thermodynamic sys- 
tems, this gives rise to the Gibbs-Boltzmann distribution 
Poo(s) oc c fcijr^^^)^ with temperature T, Boltzmann 
constant ks (we set fcs = 1 for convenience) and Hamil- 
tonian (or energy) function E{s), which usually follows 
from the transition probability W[s I s] The stationary 
distributions in systems without detailed balance (when 
such distributions do exist) are generally much more com- 
plicated and difficult to analyze 0, Q • 

In the absence of explicit time dependence, equilibrium 
systems therefore admit a reduced representation with re- 
spect to non-equilibrium ones, via the macrostates of the 
relevant (energy) functions. Some non-equilibrium phys- 
ical systems show a local equilibrium-like behavior (e.g., 
having a slowly changing temperature) that allows for a 
similar reduced representation 0; however, this requires 
full knowledge of the corresponding Hamiltonian, which 
is completely unknown in many systems, especially in 
biological, financial and technological systems. 

In past studies equilibrium and non-equilibrium sys- 
tems analyses were typically well separated. In this Let- 
ter we show that in a large class of non-equilibrium sys- 
tems, without detailed balance, one can still find domains 
that exhibit equilibrium-like |22| behavior; these may be 
of a non-localised nature and may emerge and disappear 
depending on external conditions. In order to demon- 
strate this we study two exemplar models where one may 
intuitively anticipate this type of behavior to occur, and 
equally importantly, can quantitatively analyse it. 

The two models considered here are Ising-like systems 
comprising N spins s; € {—1,1}, i G {!,..., iV}, rep- 
resenting variables (degrees of freedom) interacting on 
sparsely and densely connected networks. This type of 
system is commonly used in statistical physics as a pro- 
totype and a first approximation in modelling complex 
phenomena in many-body systems [lol |. In the densely 
connected model each variable interacts with a very large 
(order of the system size) number of variables whereas 
in the sparse model the number of interactions is much 
smaller than that of the system size. Furthermore, both 
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models have bipartite topologies where one part of the 
network serves as a non-equilibrium "environment" while 
the other is designed to be in equilibrium when considered 
on its own. 

Densely connected model: This model, de- 
scribed schematically in Figure [IJa), is gov- 
erned by the process H]) where the microstate 
s{t) = {ai{t),...,aN'-{t),Ti(t),...,TN^{t)) is repre- 
sented for clarity by two components consisting of N'^ 
and N'^ extensive degrees of freedom, respectively, 
such that N'^ + N'^ = A^; the distinction between 
the two subsystems is not obvious through interaction 
strengths. The r-component of the system (r-system) 
drives the a-component (cr-system) via stochastic 
alignment of spins {fXi} to the corresponding local 

fields h,{cj,T) = Jf.'^i + Y.T J^i^j + and is 

itself governed by the stochastic alignment of {r, } to the 
local fields g, (cr, r) = X^f Jlf^^j Jlj Tj +^1 . where 

the variables {J[j, J^j, J[j^ , J^j"} prescribe the strengths 
of the various interactions and {0'[ ,dj} are external fields 
which may depend on time. Each site in the tr-system 
(r-system) is updated in a stochastic manner with the 
probabilities P[<Ti{t + 1)] cx exp[/3cri(i 4- l)hi{a{t),T{t))] 
and P[Ti{t + 1)] cx exp[/3Ti(t -I- l)gi{a{t),T{t))], respec- 
tively, which are controlled by the noise parameter /3 
(that defines the temperature T ~ I//?); the dynamics is 
completely deterministic when /3 — > oo and is completely 
random when /? = 0. All sites are updated independently 
of each other, which leads to the Markov process ((T)). 

It is clear from the definitions of the fields that the 
two systems evolve independently and separately when 
all cross-component interactions J[j^ = J^" = 0. If 
in addition all J[j are symmetric, i.e. J[j = JJj, and 
all external fields Of{t) do not depend on time, then 
the (T-system is governed by the equilibrium distribution 
Poo(c) (X e~^^f'^"^ with Peretto's Q pseudo-Hamiltonian 

N' N" 

^^('^) = -«Elog2cosh[/3/i,(a,O)]-^0,^a,. (2) 

^ i=l 1=1 

For asymmetric cross-component interactions J[j'^ 7^ or 
Jif 7^ the complete system is not in equilibrium. How- 
ever, this does not prevent the a-system from exhibiting 
equilibrium-like behavior. To see this we consider the sim- 
plest case of J^j = Jf-' = 1 and JJ^ ^ JJj, where both 
interaction variables JJ^ and JJ^' are independent ran- 
dom variables and are assigned values of ±1 with equal 
probability; to simphfy the example we will also choose 
N'^ ^N^ ^ N/2 [2I. 

We employ the method of generating functional anal- 
ysis to obtain expectation values of various macro- 
scopic quantities, averaged over the quenched disordered 
induced by the randomly assigned values of JJ^ and 
Jlj' . It turns out that in this case the complete sys- 
tem admits a macroscopic description via the magne- 
tizations m°'{a{t)) = ^iid '"^-^(''"(0) = 
X^iLi '''j(^)- particular, for the magnetizations av- 



eraged over the process, m''{t) = {m" {a{t))) , m'^{t) = 
{vn7 (T{t))) , and in the thermodynamic limit N — > cx), 
one obtains 

{t + I) = iimk I3[rrf {t)+m''{t) +9" {t)\ (3) 
m^(t + 1) = 

with initial conditions given by m°'(0) and m'^(O). For 
0''{t) = O'' and 6'^ = Q this equation admits a stationary 
solution mf{oo) = tanh[/3(m°' (00) -f 6>°") | wh ich is exactly 
the same as one finds in equilibrium governed by 
(21). Similar argument also holds for the average density 
-1^;^ Epilog 2 cosh[/3/i,(cr,T)] -O'^^Y.f^^a,, which 
approaches the equilibrium energy Q and is a function 
of the magnetization only. Furthermore, for 9"^ = Q 
the stationary solution m"^ {00) = (disordered phase) 
is stable when /3 < 1 but bifurcates into two solutions 
|m''(oo)| 7^ (ordered phase) at /3 = 1. Thus both parts 
of the system are indistinguishable when /3 < 1. 

While we deliberately focussed on a particularly sim- 
ple and tractable model, more complex systems of simi- 
lar characteristics could be constructed to demonstrate 
the existence of equilibrium-like domains in a non- 
equilibrium environment. 

Sparsely connected model: The model considered here 
is a sparsely connected Ising ferromagnetic system de- 
fined on an TV-node random regular graph where each 
node is randomly connected to exactly fcs 0{N'^) other 
nodes. The system evolves by selecting a node i with 
probability 1 /N at each time step and aligning its state 
to the local field hi(a) = J X^jeSj '^j with probability pro- 
portional to el^'^i^i^'^) , where di is a set {\di\ = k) of sites 
directly connected to site i. This leads to a Markovian 
process in continuous time (see Appendix). Furthermore, 
a fraction p of (randomly selected) spins in this system 
are driven by the random time-dependent external fields 
9i{t) e {-1, 1}, where P{9,[t) = ±1) = 1/2, i.e., in these 
sites the field hi{a) is effectively changed to hi{(j)+9i{t). 

Without external fields and after long time [t — > 00) 
the system is in thermal equilibrium and the spins are 
governed by the Gibbs-Boltzmann distribution with the 
Hamiltonian E{(j) = — '^i'^j- the equilibrium 

the average energy and magnetization are given respec- 
tively by the equations 

^_ 1^ tanh(/3J) + tanh(/3/i)2 
^2 I + tanh(/3 J) tanh(/3/i)2 
m = tanh{tanh~^[tanh(/3J) tanh(/3ft,)]fc} , 

respectively, where ft, is a solution of /i = ^(^ ^ 
1) tanh^^ [tanh(/?J) tanh(/3ft,)] [l^. The system is in an 
ordered (disordered) state if T < (T > T^), with 
= J/tanh~^ being the critical temperature of the 
system. In the presence of time-dependent external fields 
convergence to thermal equilibrium is no longer guaran- 
teed, but part of the system, which is not directly af- 
fected by the external fields, can exhibit equilibrium-like 
behavior as can be seen in Figure [IJb). This phenomena. 




FIG. 1: (a) Densely connected system composed of equilibrium (cr-system, blue nodes) and non-equilibrium (r-system, red 
nodes) components. Blue and red edges represent positive and negative interactions, respectively. Interaction directions are 
not shown, (b) Properties of sparse systems exhibiting equilibrium-like behavior. The degrees of freedom (blue nodes) are 
interacting on graphs with locally tree-like topology. A fraction of these nodes (red) are exposed to the changing environment 
(perturbations). Macroscopic observables of the un-perturbed nodes suggest they are in thermal equilibrium at low temperature 
as the influence of perturbations on the macroscopic observables is negligible (left - E panel); as one approaches a critical tem- 
perature, the system becomes very sensitive, develops long-range order and exhibits significant deviations from the equilibrium 
values of these observables (middle - NE panel). The transition point is determined by the point where deviation from the 
equilibrium values exceed thermal fluctuations and represents an estimate. The perturbations become negligible again at the 
high temperature region as one moves away from the critical temperature Tc (right - E panel). This qualitative explanation 
is supported by comparing the equilibrium energy E (dashed line) and magnetization m (solid line) with the average energy 
E{a) = — -i- X](ij> <^i<^3 and magnetization densities m{a) = i Tli^i '^i measured in Monte Carlo simulations (symbols) of a 
ferromagnetic Ising spin system, defined on a random regular graph of size A*' — 10® with fe = 3, where a fraction p = 0.05 of 
sites are subject to the external time-dependent random binary fields 9i{t) £ { — 1, 1}, with P(6i{t) = ±1) — 1/2; all Monte Carlo 
simulations results reported here have been carried out for a similar system size and connectivity degree. The measurements 
are taken only on sites not influenced by di{t). (c) Deviations from equilibrium, shown in NE panel of (b), are much larger than 
one usually finds due thermal fluctuations alone in equilibrium. We compare thermal fluctuations of the equilibrium energy E 
(dashed line) and magnetization m (solid line) with those measured in Monte Carlo simulations (represented by symbols with 
error bars, much smaller than the symbol size, on the solid lines). The non-equilibrium simulation measurements (symbols with 
error bars) are taken only at sites not influenced by 6i{t) and show clear deviation from the equilibrium values, (d) Comparing 
the magnetization m (solid lines) calculated theoretically with values (symbols) measured in the Monte Carlo simulations of 
ferromagnetic Ising spin system defined on an asymmetric (an incoming edge with probability 1/2) random regular graph show 
good agreement between the two. 



vanishes when the temperature T in the system is close 
to Tc- The presence of this phase transition seems to 
magnify the non-equilibrium effect of an external driving 
field which is much larger than one usually finds due to 
the thermal fluctuations alone, in equilibrium, as can be 
seen in Figure [TJc). We note that similar behavior also 
occurs in a system defined on a Cayley tree where bound- 
ary sites are subject to the same external fields [l3l [. 

Alternatively, the 9i can be viewed as a field induced 



by a non-equilibrium part of the system. In the long time 
limit i — oo, this system is equivalent to the setup where 
one part of the system (asymmetric) drives the other 
(symmetric). The sites affected by the asymmetric part 
are described by the set {mi(t)} of local magnetizations 
= '^^Pt{o') cFi. Furthermore, if the stationary 
point of these local magnetizations is exactly mi(t) = 0, 
the asymptotic behavior of the system is equivalent to 
that of the system depicted in Figure [TJb). 
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To verify this we assume that for asynchronous dynam- 
ics on an asymmetric regular graph the local magnetiza- 
tion ini{t) is a function of the local magnetizations rrijit) 
of its neighbors j € di only. For fc = 3 this leads to the 
following set of equations 



r (^ + 7r)E,e 



di' 



dt 



+ 6r rijgai'^i 
itanh(2/3)£j.ga^mj 
tanh(^) Y^jedi 




if \di\ = 3 

if \di\ = 2 

if \di\ = 1 

if \di\ = 



where A = (27 tanh(;3)-tanh(3/3))/24 and T = (tanh(3/3)- 
3 tanh(/3))/24. which is valid for single instances of asym- 
metric regular graphs as can be seen in Figure [TJd). 

Recent studies of neural populations [ij], flocks of 
birds [l5l |. magnets [l6| and of many other natural and 
technological systems, suggest the existence of equilib- 
rium domains in non-equilibrium systems. However, to 
show the emergence of such domains in practice may 
prove difficult, especially if they are composed of non- 
localized degrees of freedom; for instance, a group of 
traders located in different stock markets and aiming 
to maximize their profits may (possibly inadvertently) 
constitute an equilibrium-like system. This Letter aims 
to change our viewpoint on the traditional separation 
between equilibrium and non-equilibrium systems in or- 
der to understand the emergence of equilibrium behav- 
iors within non-equilibrium systems and possibly facili- 
tate control of this phenomenon. The exemplar models 
systematically analyzed here represent the first step to- 
wards this goal; they demonstrate the emergence of such 
domains and their dependence on various system param- 
eters as well as their dissipation close to criticality. In the 
real world such systems may emerge randomly or evolve 
in a structured manner through a selection process. The 
study opens up exciting opportunities for future work on 
the role and dynamics of equilibrium domains in systems 
with adiabatically changing interactions and parameters, 
such as coordinated global trade and social networks. 
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Appendix A: Processes on graphs 

We consider a system of N Ising spins, Ui G {—1,1}, 
which are placed on the vertices of a graph and interact 
only when they are connected. Their microscopic dynam- 
ics are governed by a Glauber type stochastic algorithm 



where a spin on site i is flipped with probability 



Via, 



(Al) 



2cosh(/3/i,(cr))' 
where hiia) is a local field defined as 

h^{(J)=^JiJa.J^'e,, (A2) 

with di being the set of sites connected to site i and 
where we have used the notation <j = (cti, . . . ,<jn)- The 
parameter j3 controls the level of noise in the system; the 
dynamics is completely random when /3 — > and com- 
pletely deterministic when /3 — ^ cxj. The parameter 9i 
defines an external field. The set of variables { Jy} pre- 
scribes the strengths of interactions between the spins. 
Once chosen these variables are kept fixed for the dura- 
tion of the process. 

In order to complete the above algorithm we have to 
specify how we choose the sites for each update accord- 
ing to (|A1[) . A simplest choice is to update all sites si- 
multaneously which gives rise to the parallel dynamics 
governed by the Markov equation (this type of dynamics 
is popular in the modeling of neural networks |ll| ) 



a' 

with the transition probability 



N 



LI 2cosh(^/ii(cr')) 



(A3) 



(A4) 



For the symmetric interactions, i.e. Jij = Jji, the 
detailed balance property W[a'\a] P(cr) = W[a\a'] P(ct') 
is always satisfied. If in addition the ergodic property 
(3 t' such that for V t > : Pj (cr) > 0) is satisfied then the 
process (jA3p converges Q to the equilibrium distribution 



P^(a)(xe-''^^('^), 



(A5) 



where Ep{a) is the pseudo-Hamiltonian (this is not a 
proper Hamiltonian because of its explicit dependence 
on the noise parameter (3) 



N N 



(A6) 



1=1 



A slightly more complicated scenario is when the sites of a 
system are updated asynchronously in the following man- 
ner: at each iteration of the algorithm a site i is drawn 
randomly and independently from the set {1, . . . , of 
all sites then the spin Ui of this site is updated with 
the probability (|Aip (this is one of the main algorithms 
used to study the dynamics of Ising-type magnetic sys- 
tems [13 )■ This process naturally leads to the Markov 
equation [Tsj in continuous time 

d ^ 

— Pt(a) = ^ [Pt(ai,...,^,;,...,ajv)P(tT,^(70(A7) 



Pt(cri,. . .,crAr)P(cr^-^-crj)]. 
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As in the case of synchronous dynamics (jASp the pro- 
cess (jA7p satisfies detailed balance only for symmet- 
ric interactions and it evolves towards the equilibrium 
Gibbs-Boltzmann distribution Poo(f) cx e^'^^(°'', with 
the Hamiltonian (or energy) function 



N 



E{(t) = - ^ Ji](7i(Jj - ^ 9i(7i 



(A8) 



(the first sum is over all edges in the graph), which is 
a unique stationary solution when the process (jA7p is 



ergodic. 



Appendix B: Dynamics of a densely connected 
model 



1. Generating functional 

In this section we study dynamics of a densely con- 
nected Ising spin system governed by the Markov process 
with the transition probability given by 



W[a(t+l),T(i+l)|a(t),T(t)] = J] 



^fta,{t+l)h,{a{t),T{t)) Ql3rt{t+l)g,(a{t),T(t)) 



n 



where hi{a,T) = Ej^i ^5^^' + 'W'^o 



(Bl) 



\ 2cosh[/3/i,(a(i),T(i))] 2cos\v[Pgt{a{t),Tm ' 

I 

and of various macroscopic quantities in this system can be 



g^{^.r) = Y^f JJfa, + E™^. JI,r, + 91- The averages 



conveniently computed from the generating function 



exp 



■ TV" 



(B2) 



r 



where the average (• • • ) is taken over the microscopic tra- site indices i 
jeetories cr(0),T(0) ■ ■ ■ ^ cr(imax), T(tniax) occurring 
with probability 



tmax-l 



P(a(0))P(r(0)) J] W[<7(m),r(m)|a(t),r(t)]. (B3) 



dhi{t) dhi{t) ^ih,(^t)lhi{t)-hi{cr{t),r{t))] 



2tt 



(B4) 



27r 



Inserting into the generating function (|B2p the following 

integral representations of (5-functions for all times t and we obtain 

I 



{dh dh dg dg} exp 



tmax-l 



X E] exp 

{'^.(t),n(t)} 



t=o 



E {h{t) ■ h{t) + m ■ 9{t)} 

t=o 

E {Ht) ■ h{a{t),T{t))+git)-9Ht),r{t))} 



(B5) 



xP[cr(tmax),T(t ^a(l),r(l) 

|/i(W-l),,9(tmax-l),--- ,/i(0),,9(0)]P(a(0))P(T(0)) 



X exp 



-ij2{r{t)-<7{t) + r{t)-T{t)} 



i=0 
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where we in the above have used the following definitions 



and, to reduce notation, we used various variables in a 
vector form {h{t) = {hi{t), . . . ,hN{t)), etc.) wherever 
possible. 



which contains all information about the structure of our 
model. For the sake of simplicity we take the interac- 
tions J^j = jf^, = "^77^ ^-iid -^Ij^ ^''S i'^'^" 
dom independent variables drawn from the distributions 

- 7wl + ¥^Jh + iw) \5{Jjr '^) + 
\5{JJ^'^ + ^^j^^ ) respectively. The scaling of these in- 
teractions will allow us to take the thermodynamic limit 
later on. First, however, we have to deal with the dis- 
order in interactions. Assuming that the system is self- 



(B6) 



(B7) 

I 

In order to proceed with the computation of (jBSp . we 
have to specify the interaction variables in the term 



(B8) 



I 

averaging |T9| (which is expected for a very large system) 
allows us to take disorder averages in (jBSp . 

2. Disorder averages 

Let us now take the averages in the disorder-dependent 
part of (|B8l) 



{dh dh dg dg} 




P [tT(imax), T(<„,ax) < ^ fT(l) , T (1) | /l(t,„ax - 1) , 5 (Wx - 1) , ' ' ' , h{0) , g{0)] 

= 11 jll 2cosh[/3/i,(t)] n 2cosh[Mt)] J 



exp 



(•max — -L 

-i £ {h{t) ■ hiait),Tit)) + m ■ 9Ht),rit))} 



n '^^p 



t=0 



X exp 



N" 



i=l 
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N" 1 


n ^'^p 








t=0 


f=i 




k^e ) _ 



(B9) 



nn-p 

£=1 k^l 

nn- 

«=1 k^l 

]Jcxp 



t=o 



■{-^JJ- 



'N 



t=o 



]^exp 

k^l 

N' 

JJ^ COS 

\ 2' 



t=0 



TV" 



2N 



TV 



J|cxp 



k^e \ t=o 



cxp 



t=0 



1 



TV" 



2N 



k^e t,t' 



exp 



TV" 



In the above we have used the asymptotic identity 
cos(a;) — exp(— ^ + 0(x'*)) as x — )■ to obtain the 



3. Order parameters 



quadratic form in the last Une of (|B9|) . We note that 
for any interactions of the form with random J sam- 
pled from the (well behaved) distribution P(J), with 

/ dJ P(J)J = and / d J P(J)J^ = 1, the result of and the results of disorder averages from the section IB 2 



Using the scaling of interactions from the section IB 1 



the disorder average (|B9p remains the same. 



we obtain the disorder-averaged generating functional 



r[V''^,V'^] = / {d/i d/i dg dg} exp 



tmax-l 



X X^ exp 

{'^.(t),n(t)} 

AT" 

X exp 

£=1 



t=0 



£ {mo . [Mi) - 0%t)] + .g(i) . [git) - r (t)]} 



(BIO) 



-iE E ^^w<|4^E^^w+^E^^w 



i=l t=0 



T\2 



2A^ 



rEEff^W5^(^')r.(0Tfe(t') 



fc5<tf t,t' 



exp 



AT" 



2iV' 



^EE3^W3^(*')^.W^.(i') + 0(iV") 



m t,t' 



xP[(T(t„iax),T(t 

max y ^ 

^a(l),r(l) 

|/»(tmax - l),5(tmax - 1), ' ' ' , /l(0) , g(0)] P (a(0))P (t(0)) CXp 

I 

Inserting into above the following representations of unity 
for all times t 



-iY.{r{t)-a{t)+r{t)-rm 



Am'^jt) dTO'"(t) iJVm"(t)[m-(t)-^E">.(t)l = 1 

Am^{t) dm"(t) ijv-,-„x(t)[„x(t)__^5^«;,^(4)] ^ 



(Bll) 
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J 27r/iV'^ 
J 2tt/N- 



and using that they are just integrals over the (5-functions 
in their Fourier representation, we obtain 



(B12) 



X exp 



iN^ m^{t) m''{t) + iA^^ ^ t') q^t, t') 
t t,t' 

tmax~l ^"^ f /- 

E n n W <5 - J'^m'^lO - J^^^m-(i) - 0f (t) + A,'' (a, r)) 



{<T,(t),ri(t)} t=0 t=l 

{d5 dg} J]^ exp 



exp 



E aimit, t'Mt') + Af{a, t) 



X exp 



1=1 



t t,i' 1=1 

max / ^ 

<- <t(1),t(1) 

|/j(tmax - 1), 5(W - 1), • • • , /i(0), 9(0)] P(a(0))P(T(0)) exp 



-iY,{r{t)-ait)+rit)-rit)} + 0{N') 



where in the above we have used the following notations and 

J {dm'"dm'"dm^dm^d(7'"d(7'"dg^dq^} = (B13) 
dm'^(t) dm'^(t) f dm^{t) dm^(t) 



Ait,t') = q^t,t') + 



q^t,t'). (B14) 



2t:/N'' J 271 /N^ 
dq-{t,t')d(f{t,t') [ dq-{t,t')d(nt,t') 



2t: IN'' 



2t:/N^ 



The corrections A^((t, r) = j^ai{t) + '^jy^ Ti{t) and 



(a,r) = ].{rfY.9^{t)\^n{t)n{t') + ^ 



ae{t)ai{t') \gi{t') 



contribute to the 0{N^) term in the equation (IB12p . Using the Gaussian integral identity 



9 



exp 



/{d0}exp 



(27r 



t.t' 



(B15) 



allows us to linearise the quadratic form in the equation ables gives us 
(|B12p . This with subsequent integration over the g vari- 

I 



J {dm'"dm'"dm^dm^d(?'"dg'"dg^d(7^} exp 



t t,t' 



(B16) 



X exp 



t.t' 



tm„x-i r w 



{<j.(t),T,(t)}i=0 li=l-^ 
Af" f 



X 



n< 



{dip} exp 



1 



j2m)A'\t,t')m) 



tmax-l 



t = 



n / d.g^(i)<5(5^(i)- J>W-0JW) 



X JJexp 

i=l 



J|exp 



xP[cr(iniax),T(imax) 



a(l), T(l)|/l(t„,ax - 1), g(imax ~ 1), ' ' ' , HO) , g{0)] P(a(0))P(T(0)) 



X exp 



-iY{r{t)-m+r{t)-m}+o{N'>) 



t=0 



J {dm'"dm'"dm^dm^dq'"dg'"d(7^dg^}exp 



X exp 



N" 

X ^ exp [©(A^")] J]^ exp 

{<T.(t),T,(t)} 1=1 



exp 



t=0 



n n 



M fj-^ 2cosh[/3{J'^m'^(i) + J'^^^7n^(t) + e'f (t)}] j 2 



-[l + m-(0) a.(0)] 



JJexp 



-i^m-(t)T,(t)-i^<7"(t,i')^Ki)^Ki') 



exp 



f=0 



N 



j;;0(()A-'(i.i')*(f') 



t,t' 



rtn^l ;3r,(t+l){JXt) + eJ(t)} ^ 1 

X n :T7r7r7FT77T77^^;777TTTk[l + ™^(0)^^( 



^J-^ 2cosh[/3{J-</.(t)+0J(<)}] 
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Let us now define the two objects 
[{a,(t)}|{CW}]=cxp 



[l + m'^(0) (7,(0)] 



t t,t' 

fi<yi(t+l){J''m''(t) + J''^^ra^(t)+e'^{t)} \ ^ 



exp 



t=0 



(B17) 



LJ- 2 cosh[/3{ J'^m'^(0 + J'^^^m^it) + 9f{t)}] j 2 



[{r,(0}|{#(t)}]=exp 



t,t' 



exp 



-i£#(t)r,(0 



(B18) 



X , / J^. , ' / {d(/)} exp 



(2^)^ 



n 



L 2cosh[^{J^0(i) + 6'J(t)}] j 2 



-[1+ 771^(0) T,(0)] 



r 



Using above definitions in tlie final result of (|B16p . with 

N"' = jN and iV"^ = (1 — 'y)N we are able to write 



J 



the disorder-averaged generating functional (jB16|) in the 
form of an integral 



r[?/;'^,V^]= / {dm'"dm'"dm^dm^dg'"dq'"d(j^dg^} 



.^N'i/lm'' ,771" ,m.^ ,q'' ,4' ,ip'' ,4>^]+0{N°) 



(B19) 



where 



^'[to'", m'", m^, m^q" .q", q^ ,q\ V'^, (B20) 
= i7 ^ rn%t) m%t) + i7 ^ ^ (i, t') q%t, t') + i(l - 7) ^ {t) m^t) + i(l - 7) ^ q^{t, t') q^t, t') 



t,t' 



i=l 



1 



4=1 



J2 M-[{r,(t)}|M(t)}] 

{r,(t)} 



Now for — > 00 we can use the saddle-point method to 
evaluate this integral. 



4. Saddle-point problem 



The integral (jB19p is dominated by the extrema of the 
function (jB20p . To obtain these we solve the equations 
|g = 0, where e {m"^, m'^, m^, m^, g"^, g"^, g"", g^}, 



which gives us 

im"(t)=/3J'^(((7(< + l))j^„ 

- tanh [13 {.rm^it) + .r^^m'it) + O^it)}] 

im^(i) = -^I3r^^( (a{t + l)) 
1 — 7 V 



(B21) 



/M" 



- tanh [13 {J^m^it) + J'"^^TO^(t)}] 

q^t,t') = {a{t)a{t'))^. 
q^{t,t')^{Tit) T{t'))^. 

where the averages (•••)m" ^^^'^ (''')m^ generated 
by the (site independent) weig ht functions in (|BT7l) and 



(jBlSp respectively. 

In order to show that the equality \(f{t,t') 
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iq°'{t,t') = is true, we first, using the Gaussian identity (|B15p . rewrite the equation (jB18[) as follows 
I 



[{nm {#W}] - / {d9i{t) dgm IMt)}; {9i{t),gm\ 



-i^m^W Mt)^iY,r{t,t') n{t) nit') 



X exp 



i E 9i(.t)[9i{t)-9J{t)] 



t=o 



exp 



n 

t=0 



where A{t,t') = {t,t') + [^^] t')- 



g/3Tf(t+l)gf(t) ] 1 



2 cos 



[1 + m''(0) T£(0)] exp 



t=o 



From the above it is clear that 
d 



dq{t,t') 



A log 



{rem 



but also 



52 



d9i{t)dei{t') 



= {9t{t)k{t'))m- ■ 



r 



(B22) 



(B23) 



(B24) 



Now using the above results and the identity 
de-(t)de-(f) ^\^M = (since r[0,0] = 1), it is not diffi- 
cult to show that the equality i<f{t,t') — i(f{t,t') = is 



J 



true. Application of this equality in the equations (|B2ip 
leads to further simplifications after which we obtain the 
following four equations 



rn^it + 1) 
m"(t + l) 
q%t,t') 
g^(t + l,t' + l) 



tanh [Pirm^it) + J'"^^m^(i) + ^ (t)}] 



(27r) 



{d0} exp 



tanh \l3r(j){t)] 



{d0}exp -lY.^it)A-\t,t'W) 



(B25) 
(B26) 
(B27) 



\A- 



i2ny 



tanh [(5J''(f>{t)] tanh [/3 J^<?i(t')] (B28) 



Now the multivariate Gaussian probability measure in variable only (with zero mean) thereby leading us to the 
the equation (jB26p can be reduced to a Gaussian of one result (3). 
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FIG. 2: Cayley tree with fc = 3 and r = 4 generations 
(edges painted in blue) with the asymmetric boundary (edges 
painted in red). 

Appendix C: Dynamics of a sparse model: Cayley 
tree 

In this section we study the dynamics of Ising spin sys- 
tem which is governed by the Markov process of Eq. (|A7p . 
This system has a Cayley tree topology of degree k with 
r generations; all edges in this tree are symmetric ex- 
cept the boundary edges which are asymmetric (see Fig- 
ure H]). The sites on the boundary are subject to the 
random time-dependent fields 9i{t) E { — 1,1}, where 
P{e,{t) = ±1) = 1/2. 

Without the contribution of asymmetric boundary the 
process (jA7[) is converging to the equilibrium Gibbs- 
Boltzmann distribution with Hamiltonian (|A8|) . For the 
ferromagnetic system with = J > and di ~ the 
free energy per spin /(/3) = — log 2 cosh(/3J) (that gives 

the average internal energy per spin (E) = ^/3/(/3) = 
— tanh(/3J)) is an analytic function of the inverse tem- 
perature /3 = y, which rules out a phase transition in 
this system for any T > [20j. 

Adding an asymmetric boundary disturbs the detailed 
balance condition and there is no guarantee that the sys- 
tem will end up in a thermal equilibrium state asymp- 
totically. Nevertheless, the symmetric part of the sys- 
tem (provided that it is at a sufficient distance from the 
asymmetric boundary) exhibits equilibrium like behavior 
as can be seen in Figure [31 

Results obtained in the Figure [3] are also valid if a 



Cayley tree is embedded in the following random graph 
topology. Suppose we generate a very large random reg- 
ular graph of degree k {N being the number of nodes). 
The number of short loops (of a finite length) is vanishing 
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2.5 




3; 


Comparing 


the equilibrium 


energy E — 



— tanh( J/T) (solid line) with the energy measured {E{a) — 
"■^ Monte Carlo simulation (symbols) on 

the symmetric part of a Cayley tree (of degree fc = 3 and of 
radius r = 19) with asymmetric boundary. For this system 
Tc — 0. The measurements are taken away from the asym- 
metric boundary (with incoming edges, pointing towards the 
center, denoted a.b. in the figure) on a sub-tree of radius 
r = {10, 12, 14, 16}. For comparison, the value of E{a) for 
the total system (symbols labeled by 'bulk') is included. The 
case of a boundary with incoming edges is also compared with 
that of a boundary with equal (on average) number of incom- 
ing and outgoing edges. 



with increasing N and only long loops of order 0(log A^) 
are present in this graph [2l| . By following the neighbors 
of an arbitrary node in this network and its neighbors of 
neighbors, etc. we can form a Cayley tree of radius r. 

Suppose we pick one of these Cayley trees and make all 
the edges belonging to it symmetric and the rest of the 
edges in the network asymmetric (incoming with prob- 
ability 1/2). The dynamics of the Ising spin on a Cay- 
ley tree is dominated by the dynamics of its boundary 
which is described by the set {mi{t)} of local magnetiza- 
tions mi(i) = J2a^ti^) which in a very large system 
{N — > oo with r ~ 0{N'^)) are dominated by the asym- 
metric part of this system. However, we have shown in 
the Letter that after long time these local magnetizations 
are vanishing and the results obtained for the original 
Cayley tree configuration holds also here. 
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